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ABSTRACT 

We  are  developing  a  novel  framework,  PRIDE  (PRediction  In 
Dynamic  Environments),  to  perform  moving  object  prediction  for 
unmanned  ground  vehicles.  The  underlying  concept  is  based  upon 
a  multi-resolutional,  hierarchical  approach  that  incorporates 
multiple  prediction  algorithms  into  a  single,  unifying  framework. 
The  lower  levels  of  the  framework  utilize  estimation-theoretic 
short-term  predictions  while  the  upper  levels  utilize  a  probabilistic 
prediction  approach  based  on  situation  recognition  with  an 
underlying  cost  model. 

In  addition  to  predicting  the  location  of  moving  objects  in  the 
environment,  we  have  extended  PRIDE  to  generate  simulated 
traffic  flow  during  on-road  driving.  In  this  paper,  we  explore 
applying  the  PRIDE-based  traffic  control  algorithms  for  the 
purpose  of  performance  evaluation  of  autonomous  vehicles. 
Through  the  use  of  repeatable  and  realistic  traffic  flow  simulation, 
one  is  able  to  evaluate  the  performance  of  an  autonomous  vehicle 
in  an  on-road  driving  scenario  without  the  risk  involved  with 
introducing  the  vehicle  into  a  potentially  dangerous  roadway 
situation.  In  addition,  by  varying  a  single  vehicle’s  parameters 
(e.g.  aggressivity,  speed,  location)  with  the  traffic  flow,  we  can 
show  how  the  entire  traffic  pattern  is  affected.  We  will  show  the 
successes  that  have  been  achieved  to  date  in  a  simulated 
environment,  as  well  as  enhancements  that  are  currently  being 
researched  and  expected  in  the  near  future. 
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1 .0  Introduction/Problem  Statement 

The  field  of  autonomous  systems  is  eontinuing  to  gain 
traetion  both  with  researehers  and  praetitioners.  Funding  for 
researeh  is  this  area  has  eontinued  to  grow  over  the  past  few 
years,  and  reeent  high  profile  funding  opportunities  have 
started  to  push  theoretieal  researeh  efforts  into  praetieal  use. 
Autonomous  systems  in  this  eontext  refer  to  embodied 
intelligent  systems  that  ean  operate  fairly  independently 
from  human  supervision. 

Many  believe  that  the  DEMO  III  Experimental 
Unmanned  Vehiele  (XUV)  effort  represents  the  state  of  the 
art  in  autonomous  off-road  driving  [10].  This  effort  seeks  to 
develop  and  demonstrate  new  and  evolving  autonomous 
vehiele  teehnology,  emphasizing  pereeption,  navigation, 
intelligent  system  arehiteeture,  and  planning.  It  should  be 
noted  the  DEMO-III  XUV  has  only  been  tested  in  statie 


environments.  It  has  not  been  tested  in  on-road  driving 
situations,  whieh  inelude  pedestrians  and  oneoming  traffie. 

There  have  been  experiments  performed  with 
autonomous  vehieles  during  on-road  navigation.  Perhaps  the 
most  sueeessful  has  been  that  of  Diekmanns  [4]  as  part  of 
the  European  Prometheus  projeet  in  whieh  the  autonomous 
vehiele  performed  a  trip  from  Munieh  to  Odense  (over 
1,600  kilometers)  at  a  maximum  veloeity  of  180  km/hr. 
Although  the  vehiele  was  able  to  identify  and  traek  other 
moving  vehieles  in  the  environment,  it  eould  only  make 
basie  predietions  of  where  those  vehieles  were  expeeted  to 
be  at  points  in  the  future,  eonsidering  the  vehiele’s  eurrent 
veloeity  and  aeeeleration. 

What  is  missing  from  all  of  these  experiments  is  a  level 
of  situation  awareness  of  how  other  vehieles  in  the 
environment  are  expeeted  to  behave  eonsidering  the 
situation  in  whieh  they  find  themselves.  When  humans 
drive,  we  often  have  expeetations  of  how  eaeh  objeet  in  the 
environment  is  expeeted  to  move  based  upon  the  situation. 
When  a  vehiele  is  approaehing  an  objeet  that  is  stopped  in 
the  road,  we  expeet  it  to  slow  down  behind  the  objeet  or  try 
to  pass  it.  When  we  see  a  vehiele  with  its  blinker  on,  we 
expeet  it  to  turn  or  ehange  lanes.  WTien  we  see  a  vehiele 
traveling  behind  another  vehiele  at  a  eonstant  speed,  we 
expeet  it  to  eontinue  traveling  at  that  speed.  The  deeisions 
that  we  make  in  our  vehiele  are  largely  a  funetion  of  the 
assumptions  we  make  about  the  behavior  of  other  vehieles. 

To  date,  the  authors  are  not  aware  of  any  autonomous 
vehiele  efforts  that  aeeount  for  this  information  when 
performing  path  planning.  To  address  this  need,  we  have 
developed  a  framework,  ealled  PRIDE  (PRedietion  in 
Dynamie  Environmenis)  thal  provides  an  autonomous 
vehiele’s  planning  syslem  with  information  that  it  needs  to 
perform  path  planning  in  the  presenee  of  moving  objeets 
[8].  In  this  paper,  we  deseribe  how  we  leveraged  the 
algorithms  in  the  PRIDE  framework  to  simulate  traffie 
patterns  during  on-road  driving.  We  ean  then  use  these 
simulated  traffie  patterns  to  eontrol  vehieles  in  the 
environment  in  an  on-road  driving  arena  being  developed  at 
NIST  [9]  in  a  way  to  assess  the  performanee  of  autonomous 
vehieles  being  tested  within  these  arenas. 

In  Seetion  2,  we  survey  some  related  work  in  traffie 
simulation.  In  Seetion  3,  we  deseribe  the  various 
eomponents  of  the  PRIDE  framework.  In  Seetion  4,  we 
show  how  the  PRIDE  framework  ean  be  applied  to  traffie 
simulation  for  on-road  driving.  In  Seetion  5,  we  explain 
how  this  traffie  simulation  ean  be  used  to  apply 
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performance  metrics  for  autonomous  vehicles.  Section  6 
concludes  the  paper. 

2.  RELATED  WORK 

Most  of  the  work  in  the  literature  dealing  with  drivers’ 
actions  and  predicted  behavior  has  been  performed  by 
psychologists  in  an  attempt  to  explain  drivers'  behaviors  and 
to  identify  the  reasons  of  certain  dysfunctions. 

There  have  been  a  few  efforts  that  have  tried  to  simulate 
traffic  patterns.  One  of  more  prominent  ones  in  the  literature 
is  ARCHISM  [3,5],  but  even  this  effort  is  based  upon 
driving  psychology  studies.  These  traffic  simulations  use 
laws  that  can  be  applied  for  a  specific  environment  or  a 
specific  situation.  Some  of  those  postulates  can  be  expand 
to  generic  situations  but  still  attached  to  a  kind  of  situation. 

3.  THE  PRIDE  FRAMEWORK 

We  are  using  the  4D/RCS  (Real-Time  Control  System) 
reference  model  architecture  [1]  as  the  basis  in  which  to 
apply  the  representational  approaches  that  are  being 
developed  in  this  effort.  4D/RCS  was  chosen  due  to  its 
explicit  and  well-defined  world  modeling  capabilities  and 
interfaces,  as  well  as  its  multi-resolution,  hierarchical 
planning  approach.  Specifically,  4D/RCS  allows  for 
planning  at  multiple  levels  of  abstraction,  using  different 
planning  approaches  as  well  as  utilizing  inherently  different 
world  model  representation  requirements.  By  applying  this 
architecture,  we  can  ensure  that  the  representations  being 
developed  for  representing  moving  objects  can 
accommodate  different  types  of  planners  that  have  different 
representational  requirements. 

The  RCS  architecture  supports  multiple  behavior 
generation  (BG)  systems  working  cooperatively  to  compute 
a  final  plan  for  the  autonomous  system.  The  spatial  and 
temporal  resolution  of  the  individual  BG  systems  along  with 
the  amount  of  time  allowed  for  each  BG  system  to  compute 
a  solution  are  specified  by  the  level  of  the  architecture 
where  it  resides.  In  addition  to  multiple  BG  systems, 
multiple  world  models  are  supported  with  each  world 
model’s  content  being  tailored  to  the  systems  that  it 
supports  (in  this  case  the  BG  system).  As  such,  it  is 
necessary  for  moving  objects  to  be  represented  differently  at 
the  different  levels  of  the  architecture. 

To  support  this  requirement,  NIST  has  developed  the 
PRIDE  (PRediction  In  Dynamic  Environments)  framework. 
The  underlying  concept  is  based  upon  a  multi-resolutional, 
hierarchical  approach  that  incorporates  multiple  prediction 
algorithms  into  a  single,  unifying  framework.  This 
framework  supports  the  prediction  of  the  future  location  of 
moving  objects  at  various  levels  of  resolution,  thus 
providing  prediction  information  at  the  frequency  and  level 
of  abstraction  necessary  for  planners  at  different  levels 


within  the  hierarchy.  To  date,  two  prediction  approaches 
have  been  applied  to  this  framework. 

At  the  lowers  levels,  we  utilize  estimation  theoretic 
short-term  predictions  via  an  extended  Kalman  filter-based 
algorithm  using  sensor  data  to  predict  the  future  location  of 
moving  objects  with  an  associated  confidence  measure. 
Estimation-theoretic  schemes  using  Kalman  Filters  (KFs) 
are  well  established  recursive  state  estimation  techniques 
where  estimates  the  states  of  a  system  are  computed  using 
the  process  and  observation  models  [6].  The  recursive 
nature  of  the  algorithm  utilizes  the  system's  CPU  more 
uniformly  to  provide  estimates  without  the  latency  resulting 
from  batch  processing  techniques.  The  (linear)  KF  is  simply 
a  recursive  estimation  algorithm  that  provides  minimum 
mean  squared  estimates  (MMSE)  of  the  states  of  a  linear 
system  utilizing  knowledge  about  the  process  and 
measurement  dynamics,  process  and  measurement  noise 
statistics  subject  to  Gaussian  assumptions  and  initial 
condition  information.  When  these  assumptions  are 
satisfied,  the  estimates  provided  by  the  Kalman  filter  are 
optimal.  The  extension  of  the  linear  Kalman  filtering  ideas 
to  a  non-linear  system  is  termed  extended  Kalman  filtering. 

The  Extended  Kalman  Filter  (EKF)  is  a  linear  estimator 
for  a  non-linear  system  obtained  by  linearization  of  the 
nonlinear  state  and  observation  equations.  For  any  non¬ 
linear  system,  the  EKF  is  the  best  linear  unbiased  estimator 
with  respect  to  minimum  mean  squared  error  criteria. 
Within  the  on-road  driving  hierarchy,  short-term  prediction 
of  objects  moving  at  variable  speeds  and  at  given  look¬ 
ahead  time  instants  are  predicted  using  the  EKF.  More 
information  about  this  approach  can  be  found  in  [7]. 

At  the  higher  levels  of  the  framework,  moving  object 
prediction  needs  to  occur  at  a  much  lower  frequency  and  a 
greater  level  of  inaccuracy  is  tolerable.  At  these  levels, 
moving  objects  are  identified  as  far  as  the  sensors  can 
detect,  and  a  determination  is  made  as  to  which  objects 
should  be  classified  as  “objects  of  interest”.  In  this  context, 
an  object  of  interest  is  an  object  that  has  a  possibility  of 
affecting  our  path  in  the  time  horizon  in  which  we  are 
planning.  At  this  level,  we  use  a  moving  object  prediction 
approach  based  on  situation  recognition  and  probabilistic 
prediction  algorithms  to  predict  where  we  expect  that  object 
to  be  at  various  time  steps  into  the  future.  Situation 
recognition  is  performed  using  spatio-temporal  reasoning 
and  pattern  matching  with  an  a  priori  database  of  situations 
that  are  expected  to  be  seen  in  the  environment.  In  these 
algorithms,  we  are  typically  looking  at  planning  horizons  on 
the  order  of  tens  of  seconds  into  the  future  with  plan  steps  at 
about  one  second  intervals.  At  this  level,  we  are  not  looking 
to  predict  the  exact  location  of  the  moving  object.  Instead, 
we  are  attempting  to  characterize  the  types  of  actions  we 
expect  the  moving  object  to  take  and  the  approximate 
location  the  moving  object  would  be  in  if  it  took  that  action. 
More  information  about  this  approach  is  included  in  the 
follow  section. 


Active  research  is  exploring  the  integration  of  these  two 
prediction  approaches  in  a  way  that  the  predictions  from  one 
can  help  to  enforce  or  not  enforce  the  predictions  of  the 
other. 

Both  of  these  prediction  methods  have  been 
implemented  in  two  different  simulation  environments.  The 
EKF  approach  has  been  implemented  in  the  OneSaf  testbed 
(www.onesafcom).  OneSaf  is  a  composable,  next 
generation  computer  generated  forces  (CGF)  that  represents 
a  full  range  of  operations,  systems,  and  control  process  from 
individual  combatant  and  platform  to  battalion  level,  with  a 
variable  level  of  fidelity.  OneSaf  is  able  to  represent  moving 
objects  and  provide  the  object's  location  and  velocity  at  any 
point  in  time,  through  custom-developed  Application 
Programmers’  Interface  (API)  calls.  A  user-interface  was 
built  on  top  of  OneSaf  to  display  the  predicted  locations  of 
the  moving  objects. 

In  Figure  1,  the  triangle  represents  the  moving  object 
whose  future  location  is  to  be  predicted.  The  large  circle  in 
front  of  the  triangle  is  the  area  in  which  we  are  99  % 
confident  that  the  object  will  be  in  two  seconds  and  the 
small  shaded  circle  is  the  area  in  which  we  are  50  % 
confident  that  the  object  will  be  in  two  seconds.  For  our 
implementation,  we  found  that  the  EKF  provided  reasonable 
predictions  within  a  two  second  horizon.  A  horizon  greater 
than  two  seconds  introduced  too  much  uncertainty  to  be 
useful  for  our  autonomous  driving  scenarios. 

The  situation-based  probabilistic  prediction  approach 
has  been  implemented  in  the  AutoSim  simulation  package 
developed  by  Advanced  Technology  Research  Corporation'. 
AutoSim  is  a  high-fidelity  simulation  tool  which  models 
details  about  road  networks,  including  individual  lanes,  lane 
markings,  intersections,  legal  intersection  traversibility,  etc. 
Using  this  package,  we  have  simulated  typical  traffic 
situations  (e.g.,  multiple  cars  negotiating  around  obstacles 
in  the  roadway,  bi-directional  opposing  traffic,  etc.)  and 
have  predicted  the  future  location  of  individual  vehicles  on 
the  roadway  based  upon  the  prediction  of  where  other 
vehicles  are  expected  to  be. 

At  the  point  this  paper  was  written,  we  have  simulated 
a  handful  of  driving  situations  and  have  used  approximately 
a  dozen  costs  to  determine  the  probabilities  of  one  action 


over  another.  In  this  context,  a  cost  is  a  penalty  that  is 
incurred  by  performing  a  maneuver  or  occupying  a  state. 
Current  costs  are  incurred  based  on:  1)  proximity  to  other 
objects  in  the  environment  as  a  function  of  necessary 
stopping  distance,  2)  exceeding  or  going  below  the  speed 
limit  by  a  given  threshold,  3)  changing  lanes,  4)  not  being  in 
the  rightmost  lane,  5)  rapidly  accelerating  or  decelerating, 
and  6)  changing  lanes  where  double  yellow  lines  in  the  road 
exist,  among  other  costs. 

It  should  be  emphasized  that  costs  are  not  static 
numbers.  The  cost  that  a  vehicle  incurs  by  taking  an  action 
is  heavily  a  function  of  the  perceived  personality  and 
intention  of  the  moving  objects.  Using  these  costs,  we  are 
able  to  predict  up  to  ten  seconds  into  the  future  at  a  rate  of 
two  predictions  per  second.  A  snapshot  of  the 
implementation  is  shown  in  Figure  2  (a)  and  (b). 

4,  APPLYING  THE  PRIDE  FRAMEWORK 
TO  TRAFFIC  SIMULATION 


Although  the  PRIDE  framework  was  originally  developed 
to  inform  a  planner  about  the  future  position  of  moving 


Figure  2:  Situation-based  probablistic  prediction,  (a)  above  and  (b) 
below  show  a  vehicle  performing  a  passing  operation  around  stationary 
obstacles. 


Figure  1 :  Short-term  Prediction. 


objects  for  the  purpose  of  path  planning  and  collision 
avoidance,  we  have  found  that  the  same  set  of  algorithms 
could  be  applied  to  simulating  traffic  patterns  during  on¬ 
road  driving.  More  specifically,  we  applied  the  situation 
recognition  and  probabilistic  algorithms  to  determine  the 
likely  actions  that  a  vehicle  in  the  environment  would  take 
when  confronted  with  a  specific  situation,  and  then 
command  that  vehicle  to  perform  that  action.  By  doing  this 
with  multiple  vehicles,  we  are  able  to  simulate  fairly 
sophisticated  traffic  situations  in  which  vehicles  behave  in  a 
way  that  is  very  similar  to  how  a  human  would  behave. 
Vehicles  will  slow  down  and/or  pass  when  approaching  a 
stopped  or  slow  object  in  their  lane,  they  will  typically  only 
change  lanes  when  the  next  lane  is  clear  and  they  are  going 
slower  than  desired,  they  will  keep  a  safe  follow  distance, 
etc.  By  providing  realistic  simulations  of  traffic  situations, 
we  are  able  to  test  the  autonomous  vehicle  during  realistic 
on-road  driving  situations,  without  having  to  place  the 
vehicle  on  a  potentially  dangerous  city  street  or  highway. 

The  vision  is  that  we  will  use  these  algorithms 
originally  in  simulated  environments  (such  as  the  OneSaf 
and  AutoSim  simulation  environments  discussed  above)  to 
test  out  the  planning  algorithms  in  the  presence  of  moving 
objects.  Then,  when  the  NIST  On-Road  Driving  Arenas 
(which  are  described  in  another  paper  in  this  conference), 
are  completed,  these  algorithms  will  be  used  to  control 
“environmental”  vehicles  in  the  arena  to  simulate  on-road 
traffic. 

The  remainder  of  this  section  describes  the  details  of 
how  the  situation  recognition  and  probabilistic  algorithms 
are  used  to  simulate  on-road  traffic. 

The  basic  assumption  behind  this  situation-based 
probabilistic  prediction  approach  is  a  driver’s  behavior  can 
be  quantified  using  costs.  In  general,  a  driver  will  prefer  an 
action  that  minimizes  its  cost.  With  this  assumption,  the  cost 
can  be  converted  to  probabilities,  where  the  higher  the  cost, 
the  lower  the  probability  that  the  driver  will  execute  that 
action. 

4.1,  POSSIBLE  VEHICLE  ACTIONS 

For  the  purpose  of  the  algorithms,  we  have  discretized  the 
possible  actions  that  a  vehicle  can  make  at  any  given  time. 
Note  that  for  this  exercise,  we  have  not  accounted  for 
intersections.  All  of  the  examples  occur  on  a  continuous 
stretch  of  roadway. 

A  vehicle  can  execute  two  types  of  actions.  The  first 
type  of  action  is  regarding  its  velocity,  namely,  quick 
acceleration  (QA),  slow  acceleration  (SA),  constant  velocity 
(CV),  slow  deceleration  (SD)  and  quick  deceleration  (QD). 

The  second  type  of  action  is  regarding  lane  changing, 
namely,  changing  to  the  left  lane  (CL),  staying  in  the  same 
lane  (SL)  and  changing  to  the  right  lane  (CR).  These  are 
shown  in  Figure  3. 
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1  Figure  3;  Discretized  Vehicle’s  Actions.  | 

As  shown,  at  any  point  in  time,  the  vehicle  can  have  up  to 
15  possible  future  actions. 

4,2,  THE  PRIDE  ALGORITHMS 

In  this  section,  we  will  use  the  following  scenario  as 
shown  in  Figure  4  to  explain  the  concepts  in  the  algorithms. 
This  scenario  is  composed  by  three  vehicles,  two  (A  and  B) 
on  the  same  lane  (LI)  and  another  one  (C)  on  the  opposite 
lane  (L2)  and  a  static  obstacle  (D)  on  the  lane  LI. 
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Figure  4:  Scenario 


Figure  5  shows  the  overall  process  for  the  algorithms  (a) 
graphically  and  (b)  in  pseudo-code.  The  algorithm  proceeds 
as  follows: 

1.  For  each  vehicle  on  the  road  (a),  the  algorithm  gets 
the  current  position  and  velocity  from  external 
programs/sensors  (P). 

2.  For  each  time  in  the  future  and  for  each  starting 
position  (x),  the  algorithm  creates  a  set  of  next 
possible  positions  in  the  future  and  assigns  a  cost 
to  each  of  them  corresponding  to  the  action 
performed  and  the  state  occupied.  At  the  end  of  the 
first  prediction,  each  ending  position  is  set  at  the 
starting  positions  at  time  t  are  used  as  “starting 
position”  to  build  the  next  set  of  future  position  for 
time  t-l-L  This  loop  (6)  is  performed  tfmai  iterations, 
where  tfmai  is  the  predetermined  time  in  the  future 
that  we  wish  to  predict. 

3.  Using  the  costs  found  in  step  2,  the  algorithm 
computes  the  probability  for  each  movements  of 
the  vehicle  (s).  In  Figure  6,  ten  possible  positions 
are  shown  for  the  vehicle  (a)  A,  (b)  B,  and  (c)  C  at 
time  tfinai. 

4.  The  width  of  each  dot  in  Figure  6  represents  the 
relative  probability  of  each  action  with  respect  to 
the  others,  where  the  bigger  the  dot,  the  higher  the 
probability. 


Begin 

Loop 

For  each  vehicle  (a) 

Get  Current  Position  (p) 

For  each  time  in  the  future  (x) 

For  each  possible  actions  (6) 

Compute  All  Moves 
Calculate  Cost  Action 
Calculate  Cost  Static  Obstacle 
End  for 

Calculate  Probabilities  Action  (s) 

End  for 

Build  Predicted  Vehicle  Trajectory  {^) 
End  for 

For  each  Predicted  Vehicle  Trajectory  (r)) 
If  Probable  Vehicle  Collision 
Then  Calculate  Cost  Collision 
End  if 
End  for 

Calculate  Final  Probabilities  (0) 

End  Loop 
End. 


Figure  5  (a)  (above)  schematic  of  overall  process,  (b)  (below)  pseudo  code 


5.  The  algorithm  then  builds  the  Predieted  Vehiele 
Trajeetories  (Q  whieh  will  be  used  to  evaluate  the 
possibly  of  eolliding  with  another  vehiele.  The 
Predieted  Vehiele  Trajeetory  notion  is  explained 
later  in  this  doeument. 

6.  For  eaeh  pair  of  Predieted  Vehiele  Trajeetory  (rj), 
the  algorithm  eheeks  if  there  is  a  probable  eollision 
and  assigns  a  eost  to  the  eollision. 

7.  In  the  example,  for  the  vehieles  A  and  C,  Figure  7 
shows  that  one  possible  trajeetory  for  A  interseets  a 
possible  trajeetory  for  C,  thus  resulting  in  a 
eollision. 


Figure  6:  Predicted  Positions  of  (a)  (top)  Vehicle  A,  (b)  (middle)  Vehicle  B, 
and  (c)  (bottom)  Vehicle  C. 


8.  The  probabilities  (0)  based  on  the  eosts  of  eaeh 
aetion  are  reealeulated  based  upon  the  eollision 
information.  Figure  8  shows  the  final  vehiele 
probabilities  for  Vehieles  A,  B,  and  C.  Notiee  how 
the  size  of  the  dots  have  ehanged  from  Figure  5, 
thus  aeeounting  for  the  eost  due  to  possible 
eollisions. 


Ll 


Figure  7:  Possible  Collision  Between  A  and  C 


At  the  end  of  the  main  loop,  the  path  with  the  highest 
probability  for  eaeh  vehiele  represents  the  most  likely 
loeation  where  the  vehieles  will  be  in  tfmai  in  the  future. 
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Figure  8:  Final  Vehicle  Probabilities  for  (a)  Vehicle  A,  (b)  Vehicle  B,  and 
(c)  Vehicle  C. 

4,3,  COST  MODEL  AND  PROBABILITY 

The  moving  objeet  predietion  (MOP)  algorithms  ean  be 
separated  in  two  parts,  the  first  one  is  the  ereation  of  a  set  a 
predieted  positions  for  eaeh  vehiele  and  the  seeond  is  the 
evaluation  of  the  interaetion  between  eaeh  vehiele  on  the 
road.  Every  evaluation  is  based  on  eosts  that  are  eonverted 
to  probabilities. 

The  Cost  Model  (CM)  assigns  danger  ratings  (eost)  to 
eaeh  aetion  that  a  vehiele  ean  perform  and  the  states  that  it 


occupies  after  performing  that  action.  This  exact  cost 
assigned  to  each  action  and  state  depends  upon  the 
aggressivity  of  the  driver. 

The  cost  of  an  action  is  the  sum  of  the  costs  that  are 
encountered  by  performing  that  action,  which  could  include 
a  cost  for  changing  lanes,  a  cost  for  accelerating,  a  cost  for 
going  over  the  speed  limit,  etc.  The  cost  of  the  state  is 
described  in  the  next  section.  This  approach  for  building 
costs  is  based  upon  work  performed  in  [2]. 

4.4.  PREDICTED  VEHICLE  TRAJECTORY 

The  Predicted  Vehicle  Trajectory  (PVT)  represents  the 
possible  movements  of  a  vehicle  throughout  the  time  period 
being  analyzed.  The  PVT  is  a  representation  of  the 
trajectory,  as  shown  in  Figure  9. 

Initial  Ptisition  (IP)  Predicted  Position  (PP) 


Figure  9:  Predicted  Vehicle  Trajectory. 


The  PVT  is  built  with  the  origin  position  {xip,  yip,  tip  =  0}  at 
time  =  0  and  the  predicted  position  {xpp,  ypp,  tpp  =  tfmai} 
where  tfmai  is  the  predetermined  time  in  the  future  for  the 
prediction  process.  It  also  contains  the  action-cost  and 
action-probability  information. 

The  PVT  is  used  to  determine  possible  collisions. 
Because  the  PVT  represents  a  trajectory  of  one  vehicle 
(origin  to  predicted),  we  can  determine  possible  collision 
between  any  two  vehicles  by  determining  if  two  PVTs 
cross. 


IP  I 


Figure  10:  Two  PVTs  Crossing. 


PP2 


When  two  PVTs  are  crossing  each  other  (Figure  10),  it  is 
important  to  know  where  are  they  crossing.  This 
information  can  be  obtained  by  using  a  parametrization  of 
each  PVT. 


X^{t^)—  Xpp^t-^  +  X|p^{^  t^) 

i)  —  Yppi^ yiPii'^ 


where 


^e[0,1 


y2  ( ^2)  =  YpP2t2+YiP2i'^  -  ^2) 


^2e[0,1 


where  ti  and  t2  are  the  parameters  of  each  PVT. 

By  using  the  Theorem  of  Cramer,  ti  and  t2  can  be 
determined: 


Xppy  ^1 +X/PJ  (1  t^)  —  Xpp2t2+X|p2{^  ^2 

y ppi^  y IP1  ~  y PP2^  y iP2^'^  ~^2 

ix 


-X,a,)t^  +  {Xii 


Xpp^  ^2  ^IP2  ^IP1 


(Yppi  //pi) Ypp^^i  yiP2  y 


IP1 


^1  = 


^2^ 


Xip2  Xip^ 

Xip2  Xpp2 

yiP2~  Yipi 

yiP2~ypp2 

Xppi  —  Xjp^ 

Xjp2—  Xpp2 

I 

1 

yiP2~y  PP2 

Xppi  Xip-I 

Xip2—  Xjp^ 

Yppi  ~  Yipi 

yiP2~  Yipi 

Xppi  —  Xip^ 

Xip2  —  Xpp2 

yppi~  Yipi 

yiP2~ypp2 

So  the  two  vehicles  will  cross  each  other  at  two  different 
times  titfinai  for  the  first  vehicle  and  t2tf,nai  for  the  second  one. 
For  a  small  difference  between  the  two  time,  the  collision  is 
highly  likely.  Conversely,  if  the  difference  is  large  collision 
is  improbable. 

The  inverse  of  the  difference  between  the  two  collision 
times  represents  the  coefficient  of  the  collision  cost: 

Co///sfonCosf  = - ^ - 1 

where  M  is  a  preset  of  the  Cost  Model  for  collision  costs. 


The  parametrization: 


5.  APPLYING  TRAFFIC  SIMULATION  TO 
PERFORMANCE  METRICS 


Now  that  we’ve  deseribed  how  we  ean  simulate  traffie 
patterns,  we  will  diseuss  how  this  eould  be  used  to  assoeiate 
performanee  metries  to  an  autonomous  vehiele.  In 
evaluating  how  an  autonomous  vehiele  is  performing  during 
on-road  driving,  we  need  the  ability  to  test  that  vehiele  in 
various  driving  situations.  Those  situations  eould  be  a 
funetion  of  the  environment  (e.g.,  winding  roads,  steep 
slopes,  traffie  signals,  interseetions),  weather  eonditions 
(e.g.,  rain,  fog,  iee  on  the  roadway),  and  statie  and  dynamie 
objeets  in  the  environment  (e.g.,  traffie  barrels,  pedestrians, 
other  vehieles).  The  traffie  simulator  allows  us  the  ability  to 
dynamieally  ehange  information  about  statie  and  dynamie 
objeets  in  the  environment  in  order  to  introduee  a  variety  of 
situations  that  we  ean  evaluate  the  autonomous  vehiele 
against. 

The  traffie  simulator  allows  one  to  have  repeatable, 
realistie  traffie  patterns  that  only  vary  in  response  to  the 
autonomous  vehiele  motions.  As  sueh,  one  would  be  able  to 
plaee  two  different  autonomous  vehieles  in  an  identieal 
traffie  environment  to  evaluate  how  eaeh  performs.  If  the 
two  autonomous  vehieles  behaved  in  identieal  fashion,  the 
entire  flow  of  traffie  would  be  identieal.  Conversely,  if  the 
two  autonomous  vehieles’  behaviors  differed  in  any  way, 
the  flow  of  traffie  would  most  likely  differ  (sinee  other 
vehieles  in  the  traffie  pattern  may  be  reaeting  to  the  aetions 
of  the  autonomous  vehiele).  Metries  eould  be  assigned  to 
the  autonomous  vehiele ’s  aetions,  based  on  a  number  of 
eriteria,  ineluding  proximity  to  other  vehieles,  staying 
within  the  speed  limit,  number  of  lane  ehanges,  obeying 
traffie  signs  and  signals,  ete. 

The  traffie  simulator  also  allows  for  the  ability  to  vary 
the  aggressivity  of  drivers  on  the  road.  Using  this  eapability, 
we  eould  have  different  diffieulties  of  driving  seenarios, 
based,  in  part,  on  the  aggressivity  of  the  drivers  on  the  road, 
where  the  higher  the  aggressivity,  the  harder  the  eourse. 
One  eould  even  imagine  situations  where  an  aeeident 
among  a  pair  of  traffie  vehieles  is  imminent.  The 
autonomous  vehiele  eould  then  be  evaluated  based  upon  its 
ability  to  prediet  this  aeeident  and  take  preeautions  in  time. 

6.  CONCLUSION 

In  this  paper,  we  have  deseribed  the  PRIDE  framework, 
whieh  was  developed  to  perform  moving  objeet  predietion 
for  unmanned  ground  vehieles.  PRIDE  is  based  upon  a 
multi-resolutional,  hierarehieal  approaeh  that  ineorporates 
multiple  predietion  algorithms  into  a  single,  unifying 
framework.  The  lower  levels  of  the  framework  (not 
diseussed  in  detail  in  the  paper)  utilize  estimation-theoretie 
short-term  predietions  while  the  upper  levels  utilize  a 
probabilistie  predietion  approaeh  based  on  situation 
reeognition  with  an  underlying  eost  model.  We  showed  the 
results  aehieved  from  applying  PRIDE  in  a  simulated 
environment. 


We  have  then  shown  how  PRIDE  ean  be  extended  to 
simulate  traffie  patterns  during  on-road  navigation.  The 
PRIDE  algorithms  are  used  to  provide  the  underlying  logie 
to  eonfrol  vehieles  in  the  environment,  thus  generating  a 
realistie  flow  of  traffie.  We  use  the  predietion  algorithms 
within  PRIDE  to  determine  the  probability  that  a  vehiele 
will  exhibit  a  eertain  behavior  given  a  set  of  environmental 
eonditions,  and  then  eommand  the  vehiele  to  perform  the 
aetion  whieh  has  the  greatest  probability.  By  doing  this,  we 
are  able  to  ereate  realistie,  repeatable,  and  non-seripted 
traffie  patterns  that  elosely  mimie  the  types  of  traffie  flow 
expeeted  to  be  eneountered  during  on-road  driving. 

We  then  explore  how  the  PRIDE-based  traffie  eontrol 
algorithms  ean  be  applied  to  performanee  evaluation  of 
autonomous  vehieles.  Through  the  use  of  repeatable  and 
realistie  traffie  flow  simulation,  one  is  able  to  evaluate  the 
performanee  of  an  autonomous  vehiele  in  an  on-road 
driving  seenario  without  the  risk  involved  with  infrodueing 
the  vehiele  into  a  potentially  dangerous  roadway  situation. 
In  addition,  by  varying  a  single  vehiele’s  parameters  (e.g. 
aggressivity,  speed,  loeation)  with  the  traffie  flow,  we  ean 
show  how  the  entire  traffie  pattern  is  affeeted. 

The  goal  of  this  paper  was  to  deseribe  how  the  work  to 
date  in  moving  objeet  predietion  eould  eontribute  to 
performanee  metries  for  autonomous  systems.  Though  the 
algorithms  deseribed  in  this  paper  have  been  developed  and 
implemented,  there  is  still  mueh  work  to  be  aeeomplished. 
For  one,  the  metries  that  should  be  applied  when  evaluating 
an  autonomous  system  in  the  presenee  of  traffie  situations 
being  generated  by  these  algorithms  need  to  be  determined. 
This  will  be  the  topie  of  future  work  and  will  be  realized  in 
the  NIST  On-Road  Driving  Arenas  mentioned  earlier  in  the 
paper.  Also,  these  set  of  algorithms  have  been  shown  to 
work  sueeessfully  on  straight  roads,  but  have  not  been  fully 
tested  on  interseetions.  This  will  also  be  a  topie  of  future 
researeh. 
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^  Certain  software  tools  are  identified  in  this  paper  in  order  to  explain  our 
research.  Such  identification  does  not  imply  recommendation  or 
endorsement  by  the  National  Institute  of  Standards  and  Technology,  nor 
does  it  imply  that  the  software  tools  identified  are  necessarily  the  best 
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